Estimating Ratios of Normalizing Constants for Densities with Diierent Dimensions Normalizing Constants with Diierent Dimensions

نویسنده

  • Ming-Hui Chen
چکیده

In Bayesian inference, a Bayes factor is deened as the ratio of posterior odds versus prior odds where posterior odds is simply a ratio of the normalizing constants of two posterior densities. In many practical problems, the two posteriors have diierent dimensions. For such cases, the current Monte Carlo methods such as the bridge sampling method (Meng and Wong 1996), the path sampling method (Gelman and Meng 1994), and the ratio importance sampling method (Chen and Shao 1994) cannot directly be applied. In this article, we extend importance sampling, bridge sampling, and ratio importance sampling to problems of diierent dimensions. Then we nd global optimal importance sampling, bridge sampling, and ratio importance sampling in the sense of minimizing asymptotic relative mean-square errors of estimators. Implementation algorithms, which can asymptotically achieve the optimal simulation errors, are developed and two illustrative examples are also provided.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Estimating Ratios of Normalizing Constants Using Linked Importance Sampling

Abstract. Ratios of normalizing constants for two distributions are needed in both Bayesian statistics, where they are used to compare models, and in statistical physics, where they correspond to differences in free energy. Two approaches have long been used to estimate ratios of normalizing constants. The ‘simple importance sampling’ (SIS) or ‘free energy perturbation’ method uses a sample dra...

متن کامل

Estimates and Standard Errors for Ratios of Normalizing Constants from Multiple Markov Chains via Regeneration.

In the classical biased sampling problem, we have k densities π1(·), …, πk (·), each known up to a normalizing constant, i.e. for l = 1, …, k, πl (·) = νl (·)/ml , where νl (·) is a known function and ml is an unknown constant. For each l, we have an iid sample from πl ,·and the problem is to estimate the ratios ml/ms for all l and all s. This problem arises frequently in several situations in ...

متن کامل

Simulating Ratios of Normalizing Constants via a Simple Identity: a Theoretical Exploration

Let pi(w), i = 1, 2, be two densities with common support where each density is known up to a normalizing constant: pi(w) = qi(w)/ci. We have draws from each density (e.g., via Markov chain Monte Carlo), and we want to use these draws to simulate the ratio of the normalizing constants, c1/c2. Such a computational problem is often encountered in likelihood and Bayesian inference, and arises in f...

متن کامل

Statistica Sinica 6(1996), 831-860 SIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION

Let pi(w); i = 1; 2, be two densities with common support where each density is known up to a normalizing constant: pi(w) = qi(w)=ci. We have draws from each density (e.g., via Markov chain Monte Carlo), and we want to use these draws to simulate the ratio of the normalizing constants, c1=c2. Such a computational problem is often encountered in likelihood and Bayesian inference, and arises in e...

متن کامل

Posterior Distributions on Normalizing Constants

This article describes a procedure for deening a posterior distribution on the value of a normalizing constant or ratio of normalizing constants using output from Monte Carlo simulation experiments. The resulting posterior distribution provides a simple diagnostic for assessing the adequacy of a simulation experiment for estimating these quantities, and is particularly useful in cases for which...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997